Kramers-Kronig, Bode, and the meaning of zero 
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The imphcations of causality, as captured by the Kramers-Kronig relations between the real and 
imaginary parts of a linear response function, are familiar parts of the physics curriculum. In 1937, 
Bode derived a similar relation between the magnitude (response gain) and phase. Although the 
Kramers-Kronig relations are an equality, Bode's relation is effectively an inequality. This perhaps- 
surprising difference is explained using elementary examples and ultimately traces back to delays in 
the flow of information within the system formed by the physical object and measurement apparatus. 



I. INTRODUCTION 

Dating from the dawn of modern quantum mechanics, 
the Kramers-Kronig (KK) relations jii^ which connect the 
frequency-dependent real and imaginary parts of a linear 
response function, have wide application. Part of their 
popularity resides in the generality of the KK relations: 
they derive essentially from causality — the response must 
follow the excitation and not precede it — and linearity, 
the superposition of responses to different causesi^i^ 

Historically, the generality of the KK relations has 
made them a valuable tool, especially when measure- 
ments are limited or theory unclear. For example, in par- 
ticle physics during the 1950s, the KK relations and as- 
sociated sum rules were helpful for making sense of scat- 
tering data and were an ingredient in the S-matrix the- 
ory used to analyze such experimentsr^ In optics, Bode's 
gain-phase version of the KK relations has been widely 
used to analyze measurements of optical properties of 
materials, especially in reflection. If the light source is 
incoherent, only the magnitude of the reflection coeffi- 
cient (the optics version of the gain) can be measured. 
The Bode gain-phase relation then determines the phase. 
Given the magnitude and phase, one can infer the index 
of refraction and absorption.-^? 

Although the KK relations are part of the "standard 
lore" taught to physics students, the corresponding rela- 
tion between the magnitude and phase of a complex re- 
sponse function is less well-known outside its specific ap- 
plications to optics, even though it was derived by Bode 
in 1937— and then popularized by him in an influential 
1945 textfi^ Even less appreciated is that while the KK re- 
lations are an equality, the Bode gain-phase relation is, in 
effect, an inequality: systems can have an "extra" phase 
shift in their response that is greater than that given 
by the Bode relations. This extra phase shift has been 
repeatedly rediscovered in various physics contexts^iiiii^ 
and is often remarked upon with surprise and explained 
in ways that are more complicated than they need to be. 

For reasons to be made clear, the Bode relation has 
been more appreciated by engineers than by physicists. 
Drawing on the engineering literature, I derive and ex- 
plain the Bode relation and give several simple examples 
where it is satisfied as an inequality rather than an equal- 
ity. Out of this exercise will come two insights: first, a 



better understanding of the gain-phase relation itself and 
of its implications; second, a better appreciation that an 
experimental measurement reflects not only the dynam- 
ics of a physical system but also how excitations are made 
and how signals are received. Choosing carefully the in- 
puts and outputs to a physical system can help eliminate 
"surprises." 



II. THE KRAMERS-KRONIG RELATIONS 

The Kramers-Kronig relations connect the real and 
imaginary parts of a causal linear response function, 
G{t). We interpret G{t) as a Green function (or impulse- 
response function) that describes the response of a sys- 
tem at time t after being excited by a delta function at 
time 0. Causality implies that G = for t < 0. Linear- 
ity implies that the measurement y{t) in response to an 
excitation u{t) is given by 



y{t) = G{t- t')u{t')dt' 



y{uj) = G{uj)u{uj). 
(1) 



In the language of engineers, y{t) is the system output, 
and u{t) the system input. The expression for y{uj) fol- 
lows from Fourier transforming and applying the convo- 
lution theorem and uses an "overloading" notation where 
the same letter denotes a function in both its time- and 
frequency-domain representations. 

We are particularly interested in the frequency-domain 
response function. 



G{oj) = G'{uj) + iG"{oj) 



G{t)e"^' dt , (2) 



where G' and G" are the real and imaginary parts of 
the response function, respectively. Note that the lower 
limit in the integral in Eq. 1^ is 0, not — cx), since G{t) 
vanishes for i < 0. 

We can extend the Fourier transform into the complex- 
cj plane and consider the complex function G over the w 
plane. Because G{t) is causal, the integral in Eq. ([3]) will 
converge for real a; if G{t) vanishes fast enough at large t. 
If it does, then the integral will converge even faster for cu 
in the upper half of the complex w-plane,-^ and one can 



then show that G(w) is analytic in the upper-half plane.A 
From these properties of G, it is straightforward to derive 
the Kramers-Kronig relationsi^"— (cf. Appendix) : 
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In Eq. ([3]), P denotes the Cauchy principal valuer^ 
which is defined by excluding from the integration do- 
main an infinitesimal region that is symmetrically dis- 
tributed about the singular point, w [see the Appendix 
and Eq. ([S]), below]. Thus, for a causal response function 
G{t), knowing the frequency dependence of the real part 
of the response function is equivalent to knowing its imag- 
inary part, and vice versa. Mathematically, the KK rela- 
tions in Eq. ([3]) are closely related to Hilbert transforms/^ 



III. THE BODE GAIN-PHASE RELATION 

The Kramers-Kronig relations connecting the real and 
imaginary parts of a response function lead to an analo- 
gous connection between the amplitude and phase. Let 
us assume that the response function G{uj) obeys the 
KK relations and that there are no values of uj in the 
upper-half of the complex w-plane for which G(a;) = 
(no zeros). If both conditions are met, we can apply 
the Kramers-Kronig to the logarithm of the response 
function.is We note that In G{uj) = In |G(w)| +iZG{uj), 
where ZG{uj) is the phase of the complex number G(w) 
at frequency cj. Then Eq. ([3]) gives 



TT Jq LU'^ - LU^ 



duj' . 



(4) 



As Bode recognized, Eq. (|3]) becomes more intuitive 
after integrating by parts. First, we change variables: 
ly = In(^), or uj' ^ lj e" , and M{iy) = ln|G(w')l> givhig 
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M{u) 
SYnhv 



dv , (5) 



Because sinh is an odd function, only the odd part of 
M{i/) contributes in Eq. ([5)). Writing M as the sum of 
odd and even functions, M = Mo + M^, we have 
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M{v) 
smhv 



dv 



lim 
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Mo{v)+M,iiy) 
sinh v 



dv 
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sinhi/ 



dv . 



(6) 



since the even contributions Me cancel in the two inte- 
grals. Now integrate by parts, noting that / jj^^ = 
— In coth ^ . Then, Eq. (JH) becomes 



2 lim 
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— ; — In coth — dv 
dv 2 



Mo In coth — 
2 



(7) 



The boundary terms vanish: 
1. As V — >■ oo. In coth ^ 



2e~'' = 2^. As w' -> 
oo, |G(a;')| ~ w'"", since physical response func- 
tions vanish at infinite frequencies. Then, ln|G| ~ 



^0. 



-?ilnw'. Thus, Mo(i^)lncothf - ii^ 

2. As z^ ^ 0, In coth | « -Inf- Since Mo is odd, 
Mo-^v + 0{v^). Thus, 1/ In J/ ^0. 

Thus, 

2 r dMo 
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TT 
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In coth — dv 
dv 2 

dM , \v\ ^ 

—, — in coth — dv . 
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(8) 



where, in the last step, we used 2Mo — M{v) — M{—v). 
Finally, we have Bode's gain-phase relation -}'' ^^^ 

dM 



:g{uj) 



dv 



f{v)dv 



/(i.)^ A In coth M, 

TT^ 2 



(9) 



where the kernel f{v) resembles a broadened delta func- 
tion (see Fig. [1]) about z/ = 0, where uj' = lo. The kernel 
is normalized so that j_ f{v) dv = 1. 




FIG. 1: Kernel f{v), with scaled frequency z^ = In — . 

To understand the implications of the Bode relation 
intuitively, consider a frequency response G{uj) ~ oj"". 
Such a relation typically holds at high frequencies for 
physical response functions. For example, a low-pass fil- 
ter has 71 = 1, and a harmonic oscillator has n — 2. If 
this relation were to hold for all frequencies w > 0, then 



dM 
dv 



dln|G| 
din a; 



(10) 



and the phase delay is ^n. More generally, n(a;) is the 
local value of In |G(w)|. In that case, we note that the 
kernel /{v) in Fig. [1] resembles a broadened delta func- 
tion, with most of its weight near v = Q (lu' = w). If n{io) 
is constant over about a decade of frequency centered on 
w, then the Bode relation is, approximately, 



ZG{lu) 



IT dln|G(a;)| 
2 din a; 



— n(uj) 
2 ^ ' 



(11) 



As a result, when the frequency response is graphed on 
Bode plots with logarithmic frequency axes and a loga- 
rithmic magnitude axis, the phase lag is approximately 
the derivative of the magnitude curve times ^ . 



IV. BODE RELATION AND OPTICAL 
RESPONSE 

In the Introduction, we noted that one of the main ap- 
plications of the Bode gain-phase relation is in the deter- 
mination of optical properties of materials. The method 
is especially useful in the far infrared (IR) , where there is 
a lack of bright, tunable, coherent sources. Instead, one 
typically measures the reflectance _R = |r^| as a function 
of frequency w, where the reflection coefficient r is the 
complex linear response function r = Eout/Ein, the ratio 
of reflected to incident electric fields. Because the source 
is incoherent, we cannot use the interference techniques 
that would normally help determine the phase. Hence, 
only R{u}) is typically available and one must numeri- 
cally integrate Bode's gain-phase relation, Eq. (0) with 
i? = G, to determine the phase (p{uj) = argi?(w). For 
a thick sample whose reflectance is measured at normal 
incidence, we then use the Fresnel formula to write^ 



r = /Re* 



n + ik — 1 
n + ik + I 



(12) 



where n(a;) is the index of refraction and k{uj) the ab- 
sorption coefficient. Knowing the complex r{uj), we solve 
for n and k numerically. 

In practice, there are a number of issues, the most 
important of which is that the reflectance R(uj) can be 
measured only over a limited frequency range, and it is 
necessary to make some plausible guesses in order to ex- 
trapolate R to all frequencies in the numerical integra- 
tion of the Bode relationi^i As long as one works with 
normal incidence and thick samples, the method makes 
possible highly accurate inferences of the phase and hence 
of the material properties n and k. Indeed, as we have 
mentioned, the technique is the standard one for such 
measurements in the far-IR frequency range. 

For oblique incidence or thin films, there are many 
cases where the phase that is deduced from the Bode 
relation underestimates the actual phase shift and 
hence leads to incorrect inferences for the material 
parameters .i^iii The failure of a naive application of the 
Bode relation in this and other cases thus motivates a 
closer look at the underlying physics. 



V. NON-MINIMUM-PHASE RESPONSE 
FUNCTIONS 

Bode's relation, Eq. (JH), is an equality for the set of 
response functions that are analytic in the upper-half 
plane (and thus obey the KK relations) and, in addi- 
tion, have no zeros in the upper-half plane. Yet many 
physical response functions that are causal and obey the 
KK relations do have zeros in the upper-half plane. Such 
response functions have extra phase delays: the phase 
lag at a given frequency is greater than that predicted 
by the Bode relation. Because these response functions 
are physical — indeed, we will give several examples — it 
makes sense to view the Bode relation as an inequality 
over the set of physical response functions. 

As an example, consider the response function for a de- 
lay T, with output y{t) ~ u(t — r). Fourier transforming, 
we have 



y{^) 



e'^^u{u) , 



(13) 



and we can identify the response function of the delay as 
Gdciay = e*'^'^. Since Gdciay(w) has an essential singular- 
ity at |a;| — > oo, the logarithm is not analytic at infinity, 
and the Bode relation does not apply. On the other hand, 
a delay is a physically possible, causal response function, 
and its real and imaginary components, G'{ui) = coswr 
and G"(w) = sinojr satisfy the KK relations, as may be 
verified by substitution into Eq. ([3]). 

We can calculate directly the magnitude and phase: 
|Gdeiay| = 1 and ZGdciay = WT. By contrast, if there is 
no delay, then Go = 1, which has |Go| = 1 but ZGq = 0. 
Thus, we have two response functions, with equal magni- 
tude response, but differing in the phase lag. Applying 
Bode's relation to both response functions predicts zero 
phase lag for both. (The exponent n = 0.) 

We have seen that if a response function contains a de- 
lay, the phase lag will exceed that predicted by the Bode 
relation. Since causality precludes a phase advance, we 
conclude that the Bode relation gives a minimum phase 
lag: such minimum-phase (MP) response functions have 
the smallest phase lag that is compatible with a given 
magnitude response. N on- minimum- phase (NMP) re- 
sponse functions have a larger phase lag. 

In addition to an exact delay, there are other NMP 
response functions that act as approximate delays. Con- 
sider the family G„(w) of nth-order rational (Fade) ap- 



proximations to the unit delay Gdoiay 
and second-order approximations are 
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1- 
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(14) 



The functions G„ all have unit magnitude. For example, 

1/2 



\Gi{^)\ 



1 



1 



1 



1 



= 1 



(15) 



2 / \ 2 

Response functions such as these with unit magnitude 
response at all frequencies are known as all-pass func- 
tions. (Because of this property, a Fade expansion is 



more useful than a Taylor expansion.) Here, we can eas- 
ily verify that the high-frequency phase lag of (?„ is n-|. 
Figure [2^ shows the Bode plots and the responses to a 
unit step of Gdoiay, Gl^ and 6*2. We note that Gi and 
G2 do indeed approximate a delayed response. Note that 
transients show "inverse response" relative to the final 
value. Indeed, the transient for G„(t) crosses the zero 
axis n times before going to its asymptotic value of 1. The 
other "feature" of the Pade approximants is that Gi and 
G2 have zeros in the upper half of the complex uj plane — 
as usual for non-minimum phase response functions — and 
poles in the "mirror position" of the lower half of the cj 
plane (see Fig. [2j:). 
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(18) 
Note in Fig. [3] how the zero of G{lu) a.t uj = i has been 
transferred to the all-pass function, while the minimum- 
phase function substitutes a "reflected" zero at lu = — i. 
The poles at — i ± 1 are untouched. 
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FIG. 3: Decomposition of the non-minimuni phase G(a;) — 
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into the product of a minimum-phase 



l-^-iuj 



and an all-pass response function j^ 



VI. EXAMPLES AND APPLICATIONS 
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FIG. 2: All-pass approximations to a unit delay, (a) Bode 
plots of Gi, G2, and Gdday. (b) Responses to a unit step, (c) 
Pole-zero plots for Gi {z = 2i, p — —2i) and G2 {z = 3i± \/3, 
p = — 3i ± \/3). Zeros are denoted by o, poles by X . 

Although the all-pass functions considered above might 
seem to be a special case of functions with zeros in the 
upper complex plane, an arbitrary NMP response func- 
tion can always be decomposed into the product of a 
minimum-phase function (MP) times an all-pass function 
(AP).i9 In symbols, 



G{uj) = Gmp(w) Gap(w) , 



(16) 



where Gmp is minimum phase and Gap is all pass. 

To see this result, we note that either G(w) is already 
minimum phase or it has zeros at w = {izi , iz2 ,■•■}• Let 
us define the Blaschke product^ 



Gap(w) 



zi 



Z2 



(17) 



which is all pass. Note that since G(i) is real, if there is 
a complex zero, its conjugate will also be a zero, as seen 
for G2(a;) in Fig. H;. 

We then define Gmp = G/Gap, which swaps the upper- 
plane zeros for their mirror refiection in the lower plane. 



We have seen that a response function has a phase lag 
that exceeds the amount predicted by Bode's gain-phase 
theorem when there is a zero in the upper half of the 
complex LU plane. In this section, we present examples of 
systems that show such NMP behavior. 



A. Flexible and multimode objects 

One class of systems that are often NMP includes flex- 
ible objects — ones whose dynamics show contributions 
from many modes. Often, the modes are extremely un- 
derdamped. As a toy model of a flexible system, consider 
a system whose output adds contributions from two un- 
damped modes, with frequencies scaled to 1 and ujq. If 
the mode amplitudes are ±a and /3, the response in the 
frequency domain is 



G.(.) = ±^-^ + - 



/3 



±a 



2_ ±a + /3 

^ ~ ±a , a ■ 



(19) 



Note how adding two oscillatory modes creates two zeros 
whose locations depend on the mode amplitudes a and /?. 
Figure |3] shows Bode plots for a case where a and /3 are 



chosen so that G+ is minimum phase and G_ is NMP. 
The minimum-phase function has an asymptotic phase 
lag of 180°, as expected for a system of relative order 
= 2, while that of the NMP system is larger (360°). We 
have added a small amount of damping {C, — 0.01 for each 
mode) to soften the phase jumps and to keep responses 
finite. The damping shifts the poles and zeros slightly 
below the real axis in the complex w-plane. The poles 
then are strictly in the lower half of the w plane, as they 
must be for a stable system. With damping, the zeros 
give rise to finite-magnitude response minima, known as 
antiresonances. 
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FIG. 4: Two-mode dynamics Bode plot, from Eq. (fT9ll . with 
a = 1, P = 2, ujo = 0.5. Black line: minimum-phase case, G+. 
Gray line: NMP case, G-. A small amount of damping has 
been added to simplify the phase plots. 

Doyle et al<^ have shown that this two-mode toy 
model has a simple realization, depicted in Fig. [51 A 
horizontal mass supported by two springs undergoes in- 
finitesimal vertical displacement z{t) and rotation 0{t). 
If a force u{t) is applied at a distance iu to the right of 
the center of mass, the equations of motion are 



mz + kz = u 

le + kfe = luu . 



(20) 



where m is the mass of the block, / its moment of in- 
ertia about the center of mass, and ^k the spring con- 
stants. Now — and this is the important step — consider 
measuring the position of the block at one of two places 
y± = z±iuO- The first, y+{t), is located where the force 
is applied; the second, y-{t), is at the symmetric location, 
tu to the left of the center of mass. If we Fourier trans- 
form Eq. (j20|) and compute the response of y±{uj) to the 
input u{uj), we find a function of the form of Eq. (J19p . In- 
deed, m — 2, k = I = \, i — 1^ and iu = -^ gives the ex- 
ample plotted in Fig.|4l Thus, if we measure the position 
of the block where the force is applied, the response is 
MP. Measured at the opposite side, the response is NMP. 
In engineering jargon, the former case is a collocated mea- 
surement and the latter a non- collocated measurement. 

The situation is similar, if more complicated when con- 
sidering a flexible object whose motion is the sum of many 
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FIG. 5: Object of mass m, length 21, and moment of inertia 
(about the center of mass) / supported by two springs, each 
with force constant ifc. The vertical displacement from the 
center of mass is z. A force u{t) is applied at right, at position 
iu- The force also acts as a torque. The output is the vertical 
displacement, y{x, t), measured at a point x along the bar. At 
the right edge {x = i), the measurement is denoted y+{t); at 
the left edge, x = —i, it is denoted y-{t). 



modes. Because each mode has a 180° phase shift, the 
alternating pattern of poles and zeros seen in Fig. 2] per- 
sists, with a zero between each resonance. If the system 
is minimum phase, the maximum phase shift will con- 
tinue to be 180°, no matter how many modes are relevant. 
Such ideas are relevant and important in the analysis of 
atomic force microscopes, which use a flexible cantilever 
to probe a surface. The speed at which one can scan a 
surface can be limited by the response of the cantilever 
to forces created by the variable surface topography. Cer- 
tain combinations of inputs and outputs lead to MP re- 
sponse, while others lead to NMP response. ^^ A design 
without unnecessary NMP zeros allows higher scan rates. 



B. Optical systems 

Optical systems provide many examples of zeros (for 
example, destructive interference). Here, we give two 
quick examples where the response is non-minimum 
phase. The first, which we have already introduced in 
Sec. IIVI occurs in the analysis of reflectance spectra, 
where the goal is to infer, from measured reflectances, 
the complex phase shift as a function of light frequency. 
The generalization of the Fresnel formula, Eq. ([T^ , to an 
oblique angle of incidence 9 gives, for TM radiation on a 
thick sample. 



rTA/(w) 



yri^ — sin 9 



'+ Vr 



2 - sin-" 9 



(21) 



where n(cij) is the complex index of refraction of the ma- 
terial under study (in air, for simplicity). As Peiponen 
and Saarinen discuss^, the response function rTA/(<^) can 
have a upper-plane zero for complex w for some combi- 
nations of n and 9. In such circumstances, there will be 
phase shifts beyond what the Bode relation predicts. If 
one does not take into account the extra phase shifts, the 



absorption inferred will be incorrect. The easiest fix is to 
choose conditions (for example, a thick sample at normal 
incidence) where the response is minimum phase. Un- 
fortunately, for a thin film, zeros associated with Fabry- 
Perot resonances are typical at all anglesJ^- If conditions 
leading to zeros cannot be avoided, independent measure- 
ments are needed to determine the phase. Measuring the 
refiectances at different angles is one possibility. 

The second example, due to Solh et aL^^ occurred 
in a recent analysis of phase-sensitive measurements of 
microwaves propagating through a waveplate. Although 
the focus of the work was to show that birefringence could 
lead to superluminal group velocities, the authors also 
noted that the phase shift showed an abrupt increase 
when the analyzer polarization angle was rotated past 45° 
with respect to the optical axis of the waveplate. Indeed, 
a linearly polarized wave incident at 45° with respect to 
the optical axis and analyzed at an angle /3 has an electric 
field 



E{lu) cx e"!'^'" [sin^e*'^'^ -|- cos/3] 



(22) 



where A0(a;) = An{uj) ujd/c, with d the thickness of the 
waveplate and c the speed of light. Here, An{uj) is the 
frequency-dependent birefringence of the waveplate and 
(j)TM is the phase shift of the TM wave. In Eq.[221 E{uj) — 
when, for integer tti. 



A0* 



nn|cot/3| +2T:{r 



(23) 



As /3 is varied about 45°, cot/3 is larger or smaller than 
1, so that Im A^* is larger or smaller than 0. Since 
A(j) ~ ujAn{uj), and since An is approximately real (and 
positive) for the conditions of the experiment, the zeros 
determined by uj* cx Acjj* change from the lower to the 
upper half plane for (3 > 45° M 



C. Implications for Feedback control 

Upper-plane zeros and NMP response functions are 
more familiar in engineering than in physics. The reason 
is that the extra delays lead to problems when attempt- 
ing to embed a NMP system inside a feedback loopi^i^i 
The basic ideas are simple: In a feedback loop, the goal is 
typically to regulate or track a reference signal. Any dif- 
ference (or error) is used to generate a correction signal. 
But phase lags due to the time it takes signals to propa- 
gate from input to output can make the control have the 
wrong correction. In particular, if a sinusoidal signal lags 
by 180°, the correction will be exactly in the wrong di- 
rection (positive feedback). If the amplitude grows each 
loop, there will be a runaway oscillatory instability. NMP 
systems exacerbate this problem by adding to the phase 
lag. In addition, the inverse response of the transients 
(Fig. [2b) also complicates the control problem. NMP re- 
sponse thus limits the amount of feedback gain that can 
be applied. ^^ 

To return to a mechanical example, a bicycle is an un- 
stable system that is stabilized when moving fast enough. 



Assuming it is, the transfer function from the steering 
angle of the front wheel to the tilt of the bike from the 
vertical has a zero in the lower-half of the complex uj 
plane. But if the bike is steered from the rear (with the 
derailleur assembly on the front wheel), then the zero is 
in the upper half plane. Such bicycles turn out to be 
practically unrideable. In 1970, Jones, in an article that 
was recently reprinted in Physics Today,^^ described at- 
tempts to create an unrideable bicycle, using an intuitive 
approach that was only partly successful (but very amus- 
ing). Astrom et al. explain how an understanding of 
bicycle dynamics can be used to make a truly unrideable 
bicycle or, more helpfully, an easier-to-ride bicycle suit- 
able for disabled children. The authors use models of 
bicycle dynamics to introduce, in a very accessible way, 
a number of ideas about control theoryi^l 



VII. GENERAL IMPLICATIONS 
A. Input and output connections matter 

Starting from the Kramcrs-Kronig relation between 
the real and imaginary parts of a linear response func- 
tion, we derived the analogous Bode relation between the 
magnitude and phase. But unlike the KK relations, the 
Bode relation is most usefully viewed as an inequality: if 
there are zeros in the upper part of the w plane, there will 
be an extra phase lag (non-minimum-phase system). In 
addition to producing the occasional "surprise" in an ex- 
periment, we saw that non-minimum-phase systems are 
difficult to control. Physically, these non-minimum-phase 
systems often correspond to situations where the input 
and output are separated in some way, so that there is a 
delay for the signal to get from the input to the output. 

In the examples discussed in Sec. I VII a consistent 
theme was that the particular choice of measured vari- 
able could determine whether the response function is 
or is not minimum phase. Where and what you mea- 
sure matters. By contrast, the resonance frequencies of 
a system are independent of the measurement details. In 
our toy example of the two-mode system, the zeros were 
functions of the amplitudes a and /3, but the poles that 
give the resonance frequencies were not. That is, the ze- 
ros of linear response functions depend on the details of 
the excitation and the sensor, but the poles depend on 
the intrinsic dynamics. The poles thus seem "more fun- 
damental" than the zeros. Still, real experiments have 
sensors to make observations and, usually, actuators to 
create some kind of controlled excitation. Experiments 
always mix intrinsic dynamics with experimental details 
of input and output connections, and the two aspects al- 
ways need to be separated. One practical lesson from the 
engineers is to be proactive and eliminate an upper-plane 
zero by rearranging sensors — choosing a different position 
to measure the block displacement, rotating a polariza- 
tion analyzer angle, or by doing more radical changes 
such as adding more sensors. Because the root of the 



problem lies in the connections of signals between the 
outside world and the system under study, redesigning 
those connections can help. 



B. Beyond linear response 

Although you might think that zeros and their related 
issues are special features of linear response, they are 
more general. It is true that notions of phase shifts are 
linked to linear systems, as they reflect a response to a si- 
nusoidal inputs. In a nonlinear system, a sine- wave input 
generates an infinite set of harmonic sine-wave outputs, 
each with its own phase shift that depends on the ampli- 
tude of the input. Although there have been attempts to 
generalize the Kramers-Kronig (and Bode) relations to a 
nonlinear case, their usefulness is not clear. ^ 

On the other hand, the concept of a zero is not special 
to linear systems. All that is required is that the output 
be zero for a class of input signals, so that when you 
measure an output, you do not know which of the input 
signals was responsible. For example, consider the time- 
domain version of an all-pass filter. 



r(t) ^ -X{t) + U{t) - U{t) . 



(24) 



Fourier transforming Eq. (I24p gives the response function 
G(u)) = i±^, which has a NMP zero at w = ?. The zero 
here means that an input of the form u{t) = uq e* does 
not affect the output, no matter what the value of uq 
(and even though the input is diverging with time). This 
signal-blocking property is another important feature of 
zeros. Clearly, though, we would arrive at the same con- 
clusion for the nonlinear equation i = f{x) + u — ii, 
with f{x) a nonlinear function. Thus, there are nonlinear 
equations with the same "pathology" as linear equations. 
A natural formulation of the nonlinear generalization of 
zeros is based on geometrical tools. ^^ 

From Eq. (|24p . we see that the output tells nothing 
about the amplitude, or even presence, of the input, uq. 
Such loss of information is a familiar idea from communi- 
cation theory, where the equivalent statement is that the 
mutual information between input and output is zero: 
the output gives no information about a set of inputs. 
The information-theory analysis of dynamical response is 
particularly attractive in that both nonlinear and stochas- 
tic effects can be accommodated in a natural wayi2^ 



Appendix 

We give here a brief derivation of the Kramers-Kronig 
relationsJ^"— If G{t) is a causal response function and 
if the response to an impulse dies away quickly enough, 
then we can assume that G{t) — > as i ^- cx) fast enough 
that the integral /„ G{t)e'^"*' dt converges. If so, then 
the integral converges even faster for complex lo with Im 



a; > 0. As a result, G{uj) is analytic in the complex w- 
plane for all Im w > 0. For simplicity, we will also assume 
that G{uj) has no poles on the real axis. 

Since G{uj) is analytic for Im w > 0, we can use 
Cauchy's Integral Theorem to write 



G(^') 



OJ' 



duj' = 0, 



(25) 



where the closed contour 7 is depicted in Figure |6l The 
semicircular indentation around the point uj is necessary 
since there is a pole in the integrand in Eq. (|25|) . 




FIG. 6: Path 7 for contour integral in Eq. (PS)| . 

The integral in Eq. (P5|) is divided into three parts, as 
labeled in Figure ID 



Part I = P 



^d.', 



(26) 



where P denotes the principal value, which simply is a 
notation to remind us that we have excluded an infinites- 
imal, symmetric region from the domain of integration. 

Part II of the integral is a semicircle of radius r — )■ 0. 
Writing w' — ut+re^^ , we can approximate G(w') by G{uj) 
and pull it out of the integral, leaving 



Part II = G(w) / 

J TV 



" ire'« 



d0 



-iTTG{uj). (27) 



Finally, we assume that G{uj') -^ fast enough for 
\ijj'\ — ?> 00 that Part III — > as the contour radius i? — > 00. 
Then, from the Cauchy theorem, Parts I + II + III = 0, 
implying 



1 r 

G{lu) = +—P / 



^i^d.'. 



(28) 



Writing G = G' -I- iG" and isolating real and imaginary 
parts gives Eq. ([3]). 
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